Voice of Sisyphus: an Image Sonification Multimedia Installation
نویسندگان
چکیده
Voice of Sisyphus is a multimedia installation consisting of a projection of a black and white image sonified and spatialized through a 4 channel audio system. The audio-visual composition unfolds as several regions within the image are filtered, subdivided, and repositioned over time. Unlike the spectrograph approach used by most graphical synthesis programs, our synthesis technique is derived from raster scanning of pixel data. We innovate upon previous raster scanning image to sound techniques by adding frequency domain filters, polyphony within a single image, sound spatialization, and complete external control via network messaging. We discuss the custom software used to realize the project as well as the process of composing a multimodal artwork.
منابع مشابه
"Musica Sull'Acqua": A motion tracking based sonification of an aquarium in real time
This paper presents a temporary multimedia installation set up at the Civic Aquarium of Milan. Thanks to four web cameras located in front of the tropical fishpond, fish are tracked and their movements are used to control a number of music-related parameters in real time. In order to process multiple video streams, the open-source programming language Processing has been employed. Then, the son...
متن کاملLOCUST WRATH: AN iOS AUDIENCE PARTICIPATORY AUDITORY DISPLAY
Mobile devices have been used in soundscape installations and performances over the past decade or longer, often to emphasize social interaction. Multichannel sonification has been found to successfully represent data describing kinematic phenomena. However, there are few if any examples where these two approaches are combined. The Locust Wrath project has evolved in stages: first, as surround ...
متن کاملSonART: A framework for data sonification, visualization and networked multimedia applications
SonART is a flexible, multi-purpose multimedia environment that allows for networked collaborative interaction with applications for art, science and industry. In this paper we describe the integration of image and audio that SonART enables. An arbitrary number of layered canvases, each with independent control of opacity, RGB values, etc., can transmit or receive data using Open Sound Control....
متن کاملDigiti Sonus: Advanced Interactive Fingerprint Sonification Using Visual Feature Analysis
This paper presents a framework that transforms fingerprint patterns into audio. We describe Digiti Sonus, an interactive installation performing fingerprint sonification and visualization, including novel techniques for representing userintended fingerprint expression as audio parameters. In order to enable personalized sonification and broaden timbre of sound, the installation employs sound s...
متن کاملTowards an Auditory Representation of Complexity
In applications of sonification, the information inferred by the sonification strategy applied often supersedes the amount of information which can be retrieved by the ear about the object of sonification. This paper focuses on the representation of complex geometric formation through sound, drawing on the development of an interactive installation sonifying escape time fractals as an example. ...
متن کامل